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We investigate a stationary random coefficient autoregressive pro- 
cess. Using renewal type arguments tailor-made for such processes, we 
show that the stationary distribution has a power-law tail. When the 
model is normal, we show that the model is in distribution equivalent 
to an autoregressive process with ARCH errors. Hence, we obtain the 
tail behavior of any such model of arbitrary order. 

1. Introduction. We consider the following random coefficient autore- 
gressive model: 

(1.1) y n = ai n y n -i-\ \-a qn y n - q + Cn, n G N, 

with random variables (r.v.'s) aj n = aj + 0"^^, where £ 1R and &i > 0. Set 

&n — (c^ln; ■ • ■ ) Ctqn) i Vn — {j]lm • • • j Vqn) > 

where throughout the paper all vectors are column vectors and ""' denotes 
transposition. We suppose that the sequences of coefficient vectors (ry n ) n6 N 
and noise variables (£ n )neN are independent and both sequences are i.i.d. 
with 

(1.2) E£!=E %1 = and E£ 2 = Er)l = 1, i = l,...,q. 

We are interested in the existence of a stationary version of the process 
(y n )n<=N, represented by a r.v. y^ and its properties. In this paper we inves- 
tigate the tail behavior 

(1.3) P(yoo>t) as t — > oo. 
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This is, in particular, the first step for an investigation of the extremal 
behavior of the corresponding stationary process, which we will study in 
a forthcoming paper. Stationarity of (1.1) is guaranteed by condition (DO) 
below. To obtain the asymptotic behavior of the tail of yoo we embed (y n )neN 
into a multivariate setup. 

Set Y n = (y n , . . . , y n _ q+ i)'. Then the multivariate process (Y n ) can be con- 
sidered in the much wider context of random recurrence equations of the 
type 

(1.4) Y n = A n Y n ^ + ( n , n€N, 

where (A n Xn)neN is an i.i.d. sequence, the A n are i.i.d. random (q x q)- 
matrices and the Q n are i.i.d. g-dimensional vectors. Moreover, for every n, 
the vector Y n -\ is independent of (A n Xn)- 

Such equations play an important role in many applications as, for exam- 
ple, in queueing; see [4] and in financial time series; see [8]. See also [5] for 
an interesting review article with a wealth of examples. 

If the Markov process defined in (1.4) has a stationary distribution and Y 
has this stationary distribution, then certain results are known on the tail 
behavior of Y. In the one-dimensional case (q = 1), Goldie [10] has derived 
the tail behavior of Y in a very elegant way by a renewal type argument: 
the tail decreases like a power-law. For the multivariate model, Kesten [14] 
and Le Page [17] show — under certain conditions on the matrices A n — that 
t x ~P(x'Y > t) is asymptotically equivalent to a renewal function, that is, 

oo 

(1.5) t x P(x'Y >t)~G(x, t) = B x J2g(x n ,t-v n ) as t -> oo, 

n=0 

where "~" means that the quotient of both sides tends to a positive constant. 
Note that if we set x' = (1,0, ... ,0), then we obtain again (1.3). Here <?(•, •) 
is some continuous function satisfying condition (4.1), (x n ) n >o and (i> n )n>o 
are stochastic processes, defined in (1.10) and (1.11). 
In model (1.1) we have ( n = (£ n , 0, . . . , 0)' and 

(1.6) An= {l^i T)' nGN ' 

where I q -\ denotes the identity matrix of order q — 1. 

Standard conditions for the existence of a stationary solution to (1.4) are 
given in [15] (see also [11]) and require that 

(1.7) Elog + |^i|<oo and Elog + |Ci| < oo 
and that the top Lyapunov exponent 

(1.8) 7= lim n" 1 \og\Ai---A n \ < 0. 

n— too 

In our case, conditions (1.7) are satisfied. Moreover, we can replace (1.8) 
by the following simpler condition; see, for example, [20]. 
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(DO) The eigenvalues of the matrix 

(1.9) Eii®ii 

have moduli less than one, where "(g)" denotes the Kronecker product 
of matrices. 

In the context of model (1.1) under the assumption that, for any n > 1, 
det(A n ) 7^ a.s., the processes (x n )n>o and (i> n )n>o are defined as 

(1.10) x = x£S, x' n = jlF^xn = DT T7> raGN > 



and 



(1.11) 



v = 0, v n = =\og\x'A 1 ■ ■ ■ A n \ 



u n = log\x' n _ 1 A n \, n€N. 

Here | • | denotes the Euclidean norm in W q and \A\ 2 = tr AA' is the corre- 
sponding matrix norm; we denote, furthermore, S = {z € M q : \z\ = 1} and 
x = x/\x\ for x ^ 0. 

Since GARCH models are commonly used as volatility models, modelling 
the (positive) standard deviation of a financial time series, Kesten's work can 
be applied to such models; see, for example, [6]. Kesten [14, 15] proved and 
applied a key renewal theorem to the right-hand side of (1.5) under certain 
conditions on the function g, the Markov chain (x n ) n >o and the stochastic 
process (v n ) n >o; a special case is the random recurrence model (1.4) with 
~P(A n > 0) = 1, for all n £ N. By completely different, namely, point pro- 
cess methods, Basrak, Davis and Mikosch [1] show that for a stationary 
model (1.4) — again with positive matrices A n — the stationary distribution 
has a (multivariate) regularly varying tail. Some special examples have been 
worked out as ARCH(l) and GARCH(1,1); see [10, 12, 19]. 

The random coefficient model (1.1), however, does not necessarily satisfy 
the positivity condition on the matrices A n ; see Section 2 for examples. On 
the other hand, it is a special case within Kesten's very general framework. 
Consequently, we derived a new key renewal theorem in the spirit of Kesten's 
results, but tailor-made for Markov chains with compact state space, gen- 
eral matrices A n and functions g satisfying condition (4.1) (see [16], Theo- 
rem 2.1). We apply this theorem to the random coefficient model (1.1). 

The paper is organized as follows. Our main results are stated in Sec- 
tion 2. We give weak conditions implying a power-law tail for the stationary 
distribution of the random coefficient model (1.1). For the Gaussian model 
(all random coefficients and noise variables are Gaussian) we show that 
model (1.1) is in distribution equivalent to an autoregressive model with 
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ARCH errors of the same order as the random coefficient model. Since the 
limit variable of the random recurrence model (1.6) is obtained by itera- 
tion, products of random matrices have to be investigated. This is done 
in Section 3. In Section 4 we check the sufficient conditions and apply the 
key renewal theorem from [16] to model (1.1). Some auxiliary results are 
summarized in the Appendix. 

2. Main results. Our first result concerns stationarity of the multivariate 
process (Y n ) n€ ^ given by (1.4). We need some notions from Markov process 
theory, which can be found, for example, in [18]. The following result is an 
immediate consequence of Theorem 3 of [9] . 

Theorem 2.1. Consider model (1.1) with A n given by (1.6), and ( n = 
(£ n , 0, . . . , 0)'. We assume that the independent sequences {rji n , 1 < i < q, n G 
N} and (£ n )neN are both i.i.d. satisfying (1.2) and that £i has a positive 
density on R. If (DO) holds, then Y n = (y n , . . . ,y n _ q+ i)' converges in distri- 
bution to 

oo 

(2.1) Y = (x + J2 A i--- A k-i(k- 

k=2 

Moreover, (Y n ) n ^ is uniformly geometric ergodic. 
Remark 2.2. (i) From (2.1) we obtain 

(2.2) F^AiFi + Ci, 

where Y± = £2 + J2T=3 A-k-\Qk = Y and Y\ is independent of (Ax, 

(ii) Since E((Ai ■■■A n )® {A x ■ ■ ■ A n )) = (E(Ai ® Ai)) n condition (DO) 
guarantees that 

(2.3) E|^i---^ n ,| 2 <ce- 7n 

for some constants c, 7 > 0. From this follows that the series in (2.1) con- 
verges a.s. and the second moment of Y is finite; see Theorem 4 of [9]. 

We require the following additional conditions for the distributions of the 
coefficient vectors (7? n )nGN an d the noise variables (£ n )neN in model (1.1). 

(Dl) The r.v.'s {r/i n , 1 < i < q,n £ N} are i.i.d. with symmetric continuous 
positive density </>(•); which is nonincreasing on R + and moments of 
all order exist. 

(D2) For some m G N we assume that E(an - ai) 2m = cr 2m Er? 2 ™ G (1, 00). 

In particular, o~\ > 0. 
(D3) The r.v.'s (Cn)neN are i.i.d. and E|£i| m < 00 for all m > 2. 
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(D4) For every real sequence (cfc)fceN with < X^fcLi \ c k\ < °°> the r - v - r = 
Ysf£=i c k^k has a symmetric density, which is nonincr easing on R + . 

Condition (D4) looks rather awkward and complicated to verify. There- 
fore, we give a simple sufficient condition, which is satisfied by many distri- 
butions. The proof is given in Section Al. 

Proposition 2.3. If the r.v. £i has bounded, symmetric density f, 
which is continuously differ entiable with bounded derivative f < on [0, oo), 
then condition (D4) holds. 

The following is our main result. 

Theorem 2.4. Consider model (1.1), with A n given by (1.6), and 
Cn = (£n> 0, . . . , 0)'. We assume that the sequences {rji n , Ki<g,n£ N} and 
{^td^SN} are independent, that conditions (D0)-(D4) hold and that + 
(Tq > 0. Then the distribution of the vector (2.1) satisfies 



The function h(-) is strictly positive and continuous on S and the parameter 
A is given as the unique positive solution of 



and the solution of (2.4) satisfies A > 2. 

The following model describes an important special case. 

Definition 2.5. If in model (1.1) all coefficients and the noise are Gaus- 
sian; that is, r]n ~ A/"(0, 1) for i = 1, . . . ,q and £i ~ M(0, 1), we call the model 
(1.1) a Gaussian linear random coefficient model. 

The proof of the following result is given in Section A2. 

Proposition 2.6. We assume the Gaussian model (1.1) with o\ > 
0. This process satisfies conditions (D1)-(D4). Furthermore, under condi- 
tion (DO), the conditional correlation matrix ofY is given by 



t— >oo 



lim t x P(x'Y >t) = h(x) 



xeS. 




(2.5) 




oc 



(2.6) R = B(YY'\A h i>l) = B + Y,M---A k _ l BA' k _ 1 ---A' 1 



k=2 



G 
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where 







• 


' °\ 


B = 


<\ 















0/ 



Moreover, R is positive definite a.s., that is, the vector Y is conditionally 
nondegenerate Gaussian and E|y| 2 < oo. 

We show that the Gaussian model is in distribution equivalent to an 
autoregressive model with uncorrelated Gaussian errors, which we specify 
as an autoregressive process with ARCH errors, an often used class of models 
for financial time series. 

Lemma 2.7. Define for the same q £ N, a* £ R, Oi > as in model (1.1), 

(2.7) x n = a 1 x n - 1 -\ h a q x n - q + yfl + H V o 2 x 2 n _ q e n , n £ N, 

with the same initial values (xq, . . . , X- q+ \) = (yo, . . . , y_q+i) as for the pro- 
cess (1.1). Furthermore, let (e n )ngN be i.i.d. Af(0, 1) r.u.'s with initial values 
(xo, • • • , X- q+ \) independent of the sequence {e n ) n& ^. Then the stochastic 
processes (x n ) n >o and the Gaussian linear random coefficient model (1.1) 
have the same distribution. 

Proof. We can rewrite model (1.1) in the form 

(2.8) y n = aiy n -i-\ h a q y n - q + \Jl + o-\y 2 n _ x H h a\y 2 n _ q e n , n G N, 

where 

~ _ jn + CriVn-irjln H h Q-qyn-qVqn M 

v /l +°"iyn-l + --- + CT 9^- 9 

are i.i.d. A/"(0,1). This can be seen by calculating characteristic functions. 
□ 

Remark 2.8. (i) Since det(^4 n ) = a qn = a q + o- q n qn , the condition 
a q + a q > and condition (Dl) guarantee that det(^4 n ) ^ a.s. 

(ii) For q = 1, model (2.7) was investigated in [3] by different, purely 
analytic methods. Stationarity of the model was shown for a 2 + a 2 < 1. 
Under quite general conditions on the noise variables, defining 

(2.9) K(X)=B\ai + a 1 e\ x , 
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the equation «;(•) = 1 has a unique positive solution A and the tail of the sta- 
tionary r.v. satisfies 

lim t A P(xoo >t) = c. 

t— »oo 

Moreover, this also covers infinite variance cases, that is, A can be any pos- 
itive value. 

(iii) Kesten proved a result similar to Theorem 2.4 for the process (1.4) 
(see [14], Theorem 6) under the following condition: There exists m > such 
that E(A*)' m > 1, where A* = A m i n (^4i^4' 1 ) is the minimal eigenvalue of AiA^. 
However, for the matrix of the form (1.6) we calculate 

A* = inf z' A\A\ z 

1*1=1 




a.s., 



In the Gaussian case, when the r/j n are all i.i.d. A/"(0, 1) with o\ > the second 
inequality implies P(A* < 1) > 0. Therefore E(A*) m < 1 for any m > 0. This 
means, however, that Kesten's Theorem 6 does not apply to the Gaussian 
linear random coefficient model. 

3. Products of random matrices. In this section we investigate the func- 
tion k(A) as defined in (2.5) for matrices (Aj)j S N presented in (1.6) derived 

from model (1.1). Notice that A± - ■ ■ A n = A n ■ ■ ■ A\ for all n G N, since the 
Aj are i.i.d. Furthermore, for any function / : W. q — > M., we write f{x') = f(x) 
for all For the following lemma we adapted the corresponding proof 

from [17]. 

Lemma 3.1. Assume that conditions (Dl) and (D2) are satisfied and 
Og + ag>0. Then there exists some probability measure v on S such that 
for every A > 0, 

k(X):= lim (Elii • • • AJ A ) 1/n = / E|x% \ x u(dx) > 0. 

Proof. Denote by B(S') the set of bounded measurable functions and 
by C(S) the set of continuous functions on S. Define, for A > 0, 

(3.1) Q X :B(S)^B(S) by Q x (f)(x) = E\x > A 1 | A /(^47) 
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for x G S and / G B(S"), where v = v/\v\ for u^O. Notice that, if / is 
continuous, then also Q\(f) is continuous, that is, Q\ : C(S) — ► C(S'). Denote 
by 'P(S') the set of probability measures on S. Since S is compact in M 9 , V(S) 
is a compact convex set with respect to the weak topology. Furthermore, for 
every probability measure a G V(S), we define the measure T a G V(S) by 

J s Q x (f)(x)a(dx) 



(3.2) T a (f)= I f(x)T a (dx) 

JS 



J s Qx(e)(x)a(dx) ' 

where e(x) = 1, / £ B(5). The operator T a :V(S) — ► "P(5) is continuous 
with respect to the weak topology and, by the Schauder-Tykhonov theorem 
(see [7], page 450), there exists a fixpoint u G 'P(S') such that T„ = i/, that 
is, T„(/) = for all / G B(5). This implies that 



Qx(f)(x)u(dx) = k(\) / /(x)i/(dx), 
J s Js 

where 

«(A)= / Q x (e){x)u(dx). 
Js 

Notice that for all n G N, 

(3.3) / Q^(/)(x)K^) = «»(A) / f{x)u{dx). 



Here Q( n ) is the nth power of the operator Q. From (3.1) follows for every 
/GB(5) 

(3.4) Q A n) (/)(^) = E|x% • • • A n | A /(^i ---An), xeS. 

Therefore, by (3.3) k u (X) = J s Q x n) (e){x)v(dx) = J s B\x'A 1 ■ ■■A n \ x i^(dx). This 
implies that K n (X) < E\Ai ■ ■ ■ A n \ x . On the other hand, we have 

(3.5) K n (\)=E\A 1 ---A n \ x [ \x'B n \ x v(dx), 

Js 

where B n = A\ ■ ■ ■ A n j\A\ ■ ■ ■ A n \. We show that 

(3.6) c* = inf f \x'B\ x v(dx) > 0. 

\B\=lJs 

Indeed [taking into account that J s \x'B\ x v(dx) is a continuous function 
of B], if = 0, there exists B with \B\ = 1 such that J s \x' B\ x v{dx) = 0, 
which means that v{x G S : x'B ^ 0} = 0. Set M = {x G S : x'B = 0} and 
g(x) = XN c i where j\f c = S \ j\f and xa denotes the indicator function of a 
set A. If jV 7^ 0, there exist vectors b\ ^ 0, . . . , b\ ^ with 1 < Z < q, such 
that 

A/" C {x G : x'5 = 0} = {x G R q : x'b x = 0, . . . , x'fy = 0}. 
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Furthermore, by (3.3), we obtain, for all n € N, 

/ Q [ l l \g){x)u{dx)=K n {\) f g(x)u(dx)=0. 
Js Js 

By (3.4) this implies for n = 2q + 1 

E / \x'A x • • • A 2q+l \ x g(x'A 1 ■ ■ ■ A 2q+l )v{dx) 
J s 

= [ B\x'A 1 ■ ■ ■ A 2q+1 \ x g(x'A 1 ■ ■ ■ A 2q+l )v{dz 
= 0. 



Since v{N) = 1, there exists some x G M such that x'A\ ■ ■ ■ A 2q+ \ G j\f a.s., 
that is, for all 1 < j < I, 

P(x'A 1 ---A 2q+1 b j = 0) = l. 

By Lemma A. 12 this is only possible if bj = 0, for all 1 < j < I; that is, if 
B = 0. But this contradicts \B\ = 1. Thus we obtained (3.6). Consequently, 

E|^ n ---Ai| A > K n (\) 



that is, 



= E\A n ---A 1 \ x [ \x'B n \ x v(dx) 
Js 

>c*E|^ n ---yii| A , 



<A)<(E|A n ---^l 1 | A ) 1 /™< k(A) 



and from this inequality Lemma 3.1 follows by taking the limit as n — > oo. 
□ 

Lemma 3.2. Assume that conditions (D0)-(D2) are satisfied andai+ ct 2 > 0. 
Then equation (2.4) has a unique positive solution. 

Proof. Denote *(n) = A n - ■ ■ A x = (^(n)). Then ^n(n) = (ai„-ai) x 

^n(n- l) + /i n , where \x n = ai^n(n - 1) + a 2n ^ 2 i(n- 1) H ^a qn ^ q \(n- 

1) independent of r\\ n . By the binomial formula and condition (Dl) (which 
implies that all odd moments of r] are equal to zero) we have for arbitrary 
meNwithCi - /2m ^ 



y 2m 



3 ' 
in 



E(* n (n)) 2m = C 2 2 4E(( ai (n) - a 1 ) 2 ^)E((M/ 11 (n - l)) 2j /4 (m ^) 

3=0 

>s(m)E(y u (n-l)) 2m , 
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where by condition (D2) s(m) = E(ai n — a\) 2m > 1 for some m > 1. Thus 
E(^n(n)) 2m > s(m) n , that is, E|^(n)| 2m > E(^n(n)) 2m > s(m) n , which 
implies that 

K(2m) = lim (E|^(n)| 2m ) 1/n > s(m) > 1. 

n— »oo 

We show now that logK(A) is convex for all A > and, hence, continuous on 
R+. To see the convexity, set 

?n (A) = -logE|*(n)|\ A>0, 
n 

and recall that logK(A) = lirrin^oo ? n (A). Then for a € (0, 1) and (3 = 1 — a 
we obtain by Holder's inequality, for A,/x > 0, 

? n (aA + < a? n (A) + (3sn(fi). 

By Remark 2.2(h) condition (DO) implies (2.3), which ensures that K(fJ,) < 1 
for all < fi < 2. Therefore equation (2.4) has a unique positive root. □ 

The proof of the following lemma is a simplification of Step 2 of Theorem 3 
of [15] adapted to model (1.1); see also [17], Step 2 of Proposition 1.2. 

Lemma 3.3. Assume that conditions (Dl) and (D2) are satisfied and 
Og + cr 2 > 0. For every A > there exists a continuous function h(-) > such 
that for Q\ as defined in (3.2), 



(3.7) Qx(h)(x)=K(X)h(x), xeS. 

The function h is unique up to a positive constant. Moreover, for q = 1, 
it is independent of x. 

Proof. For q = 1 we have S = {1,-1} and it is easy to deduce that any 
solution of (3.7) is constant on S. For q > 2 we first recall the notation of 
the proof of Lemma 3.1, in particular (3.5) and (3.6). Set, for A > 0, 

^_ Q[ n \e)(x) _ E\x'A 1 ---AX aq 

SAX) ~ «"(A) ~ K"(A) ' XG 

Using (3.5) and (3.6), we obtain sup xeS s n (x) < 1/c*. 

Notice that for any (q x g)-matrix A and A > 0, choosing A* = min(A, 1), 

\\x'A\ x - \y'A\ x \ < max(l, X)\x - y\ K \A\ x , x,y£S, 

which implies \s n (x) — s n (y)\ < (max(l, A)/c*)|x — y\ x * . By the principle 
of Arzela-Ascoli there exists a sequence (nk)k&n with — > oo as k — > oo 
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and a continuous function h(-), such that h k {x) := X)j=i s j( x )/ n k ~* h(x) 
uniformly for x G S and 

Qx{h)(x) = lim Q\{h k ){x) = lim — VQa(sj)O) 

fe— >oo K— >oo — ' 

= lim - - Sj + i(x) = K(X)h(x). 

3=1 

If h(x) = 0, for some x £ S, then Q^\h)(x) = for all n G N, that is, 

E|x%---^ n | A / l (x„) = 0, 



where x' n = x'A\ ■ ■ ■ A n , which means that h(x n ) = 0, P-a.s., for all n G N. 
From Lemma A. 9, where tt(-) denotes the invariant measure of the Markov 
chain (x n ) n >o, we conclude 

B x h(x n ) = VnGN => lim E x h(x n ) = [ h(z)ir(dz) = 

n-»oo Jc 



lim / hk(z)Tr(dz) = / h{z)it{dz) = 0. 



But on the other hand, 



[ h k (z)*(dz) = ±jr-±-r f Q 

Js n k k? (A) J s 



■ A -\ x 

1 ^ELV--^ 

n fc£i ^(A) 

where ci = inf i^i =1 / 5 \z f B\ x ir(dz). Assume that c\ = 0. Then there exists 
a matrix B with |J3| = 1, such that n(N c r\S) = for M = {x G R q : x'B = 0}. 
Denote by A(-) the Lebesgue measure on S, then A(A/"n S) = because AT 
is a linear subspace of R g . By Lemma A. 9 7r is equivalent to A; that is, 
n(M n S) = 0. This implies that vr(5) = tt{M c n S) + n 5) = 0, which 
contradicts vr(S') = 1. Hence, c\ > and /i(x) > for all x G S 1 . 

Now assume that there exists some positive function g^h satisfying equa- 
tion (3.7). Define Tl n = A\ ■ ■ ■ A n . Then for every n G N, we have 
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where f(z) = g(z)/h(z), and for every n G N, 

E x f(x'n n ) = j^E\x'U n \ x h(x 7 I^)f(x'U n ), x & S, 

that is, E x denotes expectation with respect to the measure defined in (4.7). 
Since the representation for g holds for all n (therefore for n = 2q + 1), the 
function g is continuous by Lemma A. 14. Define 

p = sup f ^ s = °\ an d K x ) = pHx) — g(x), x G S. 
xes h[x) h{x ) 

Notice that l(x) > and l(xo) = 0. Next set 

T( sKv) _ Qx(l)(y) Qf\l){y) _ Q^\hL){y) 

[V> h{y) K (X)h(y) K n {\)h{y) K»(A)%) ' V ^ ' 

We write 

Q™(hL)(y ) 
supL y = L(y ) = ram ./ ; . 
yes K n (\)h(y ) 



equivalently, for x' n = y' U n , E\y' U n \ x h(x n )L(x n ) = L(y )h(y )K n (X). More- 
over, (3.7) implies that E|yQll n | A /i(x n ) = K n (A)/i(y ) for this sequence (x n ) n > 
and therefore E\y' Il n \ x h(x n )(L(yo) - L(x n )) = 0. Th us, for all n G N , 
L(x n ) = L(yo) P-a.s. and therefore E yo L(x n ) = EL(y' U n ) = L(yo). By Lem- 
ma A. 9, with 7r(-) the invariant measure of (x n ) n >o, we get 

J^L(z)ir(dz) = Jiirn ) E yo L(x n ) =L(y ). 

Since L(-) is continuous and the measure ir(-) is equivalent to Lebesgue 
measure, we have 

L(y ) = L{z) = L(x ) = = 0, z G S. 

h{x ) 

Thus l(z) = for all z G S and Lemma 3.3 follows. □ 



4. Renewal theorem for the associated Markov chain. The next result is 
based on the renewal theorem in [16] for the stationary Markov chain (x n ) n >o 
and the processes (u n )n>o and (u n )n>i as defined in (1.10) and (1.11), re- 
spectively. Some general properties of (x n )n>o are summarized in Section A4. 
Let g:5xM->Mbea continuous bounded function satisfying 

oo 

(4.1) ^2 sup sup \g(x,t)\ < oo. 

l=-oo^S l<t<l+l 
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The renewal theorem in [16] gives the asymptotic behavior of the renewal 
function 

oo 

G(x, t) = E x g(xk,t - v k ) 
under the following conditions: 

(CI) For the processes (x n ) n >o and (u n ) n >i define the a-algebras 

F = a{x }, J r n = a{x ,xi,u 1 ,...,x n ,u n }, n G N. 

Here the initial value xo is a r.v., which is independent of (A n ) n ^. 
For every bounded measurable function f '-YWLq{S xR)^R and for 
every .F n -measurable r.v. g, 

(4.2) 

= E Xn f(g, x n+ i , u n+ i , . . . , x n+ i , u n+ i ,...)=:* (%n, o) , 

that is, 3>(x, a) = E x f(a, xi,u\, . . . ,Xi, uj, . . . ) for all x G 5" and a£K. 
Moreover, if for m G N the function / : (S x R) m — > R is continuous, 
then $(x) = E x /(xi, ui, . . . , x m , u m ) is continuous on S. 
(C2) There exists a probability measure tt(-) on 5, which is equivalent 
to Lebesgue measure such that 

l|Pi n) (-)-vr(-)l|-0, rwoc, 

for all x G S, where = sup|j| <:L J s f (y) fi(dy) denotes total variation 
of any measures /j on 5. Moreover, there exists a constant B > such 
that for all x G S 

lim — = 8 P x -a.s. 

n — >oo 77 

(C3) There exists some number m G N such that for all v G R and for all 
5 > there exist 7/^5 G and Eo — £0(^5 <5) > such that VO < e < £0 

inf P x (\x m -y vS \<£,\v m -u\<S)>0, 

where B§ v = {x G S : \x — y v ^ \ < 
(C4) There exists some I G N such that the function <&i(x, t) = E x .$(x^, vi, t) 
satisfies 

sup sup|$i(x,t) — $i(y,t)| — >-0, e^O, 
\x-y\<e teR 

for every bounded measurable function $:SxKxK->t. 
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Theorem 4.1 ([16]). Assume that conditions (C1)-(C4) are satisfied. 
Then for any function g satisfying (4.1), 




We apply this renewal theorem to 




xeS,teR, 



where the vector Y is given by (2.1) and A is the unique positive solution of 
(2.4). 

This definition corresponds to an exponential change of measure, equiva- 
lently, to an exponential tilting of the bivariate Markov process (x n , v n ) n >o 
as follows. Denote by E x . the expectation with respect to the probability 
measure P x , which is defined by 

, U\ , . . . , X n , U n ) 

(4-3) i 

= Tr ^~E,\x'A 1 ■ ■■A n \ x h(x n )F(xi,u 1 ,.. .,x n ,u n ) 
h{x) 

for each measurable function F. Then by Kolmogorov's extension P and 
E are the corresponding quantities [as P and E are for (x n ,v n ) n >o] of the 
Markov chain (x n ,v n ) n >o defined by the n-step transition densities 

p%l(dy,dw) = ^M p ^(dy,dw), 

where p^l(dy,dw) is the n-step transition density of the original Markov 
chain (x n ,v n ) n > . 

In order to apply Theorem 4.1 we need to check conditions (C1)-(C4). 
However, before we treat the general case for arbitrary dimension q, 
we consider the case q = 1 in the next example. 

Example 4.2. Consider model (1.1) for q = 1 and < a\ + a\ < 1, 
then condition (DO) holds. Define (x n ,) n >o, (v n ) n >o and (u n ) n ^ as in (1.10) 
and (1.11), respectively. Assume that conditions (Dl) and (D2) are satisfied. 
In this case the function k(-) is defined by (2.9), and Lemma 3.2 implies that 
equation k(A) = 1 has a unique positive solution. Prom Lemma 3.3 we con- 
clude that only constant functions satisfy equation (3.7), and we simply set 
h(x) = 1 in (4.3). This case is special in the sense that S = {1, —1}, that is, 
the sphere degenerates to two points, and we define the "Lebesgue measure" 
on S as any point measure with A(l) > and A(— 1) > 0. By the ergodic 
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theorem for finite Markov chains one can directly (without Lemma A. 9) 
conclude that the Markov chain {x n ) n >\ [defined in (1.10)] is uniformly ge- 
ometric ergodic with unique invariant distribution 7r = tt = (1/2, 1/2) with 
respect to both measures P and P, that is, the condition (C2) (with respect 
to P) holds with f3 = E|an| A log |an|, which is positive (cf. [10], Lemma 2.2). 

To show condition (C3) for the measure P, set m = 1 and y y g = 1 for 
v > and 5 > 0. Therefore, taking into account that by condition (Dl) the 
r.v. an has a positive density, we obtain the inequality in condition (C3) 
for any < e < 1 . 



Proposition 4.3. Consider model (1.1) with (x n ) n >o, (v n ) n >o and (u n ) ne p 
defined in (1-10) and (1.11), respectively. Assume that conditions (D0)-(D2) 
are satisfied and ai + a^> 0. Then conditions (C1)-(C4) hold with respect 
to the measure P x generated by the finite- dimensional distributions (4.3). 



Proof. First recall n n = A\ ■ ■ ■ A n and x' n = x'Tl n = x'Ii n /\x'H n \ and 
v' n = log | x'Ii n | . For every bounded measurable function (x n , v n , t ) = / (x'H n , t) , 
with f(z,t) = &(~z, log \z\, t), we have by Lemma A. 14 immediately that con- 
dition (C4) holds. 

Next we check (CI). For n,l £ N we have 



/ X n A n +i ' ' ' A n +i 

X n+ i — | , . 2 | ~~ n l\ x n, sl n+ i, . . . , S± n +l) 



and 



u n+i = log \x' n+l _iA n+ i \ = log 
= 9i{x n , A n+ i, . . . ,A n+ i) 



\X n si n +l — l ' ' ' 1 



Now for every function f -YliZoiS x ®) — * ^ anc ^ some Q ~ F n measurable 
r.v. g we calculate 

f(Q,x n +i,u n+ i, . . . ,x n+ i,u n+ i, . . . ) 

= f(Q,hi (x n , A n+ i ) , gi (x n , A n+ i ),..., 

hi(x n , A n+ i, . . . ,A n+ i),gi(x n ,A n+ i, . . . , A n+ i), . . . ) 

= fi(8, x n ,A n+ i, . . . , A n+ i, ...). 

Therefore, E(f(g,x n+ i,u n+1 , . . . )\T n ) = E(fi(g, x n ,A n+ i, . . . )\F n ) = <£(x n , g), 
where [notice that (g, x n ) is independent of (A n+ i, . . . , A n+ i, . . .)] 

a) = E/i (a, x, A n+1 , . . . ) = E/i(a, x, A x , . . . ) 

= E/(a, hi(x, Ai),gi(x, Ai), ...) = B x f(a, x^ui,...). 
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This and (4.3) implies for every m G N and every bounded function / m :lx 
(5 x R) m -» R, 

(4.4) E x (f m (g )\J r n ) = § m (x n ,Q), 

where $ m (x,a) =E x (/ m (a , X\ , , . . . , I m , ^m)) • 

Denote by \x x the measure on the cylindric cr-algebra B in Jli^o x ^) 
generated by the finite-dimensional distributions of (x±, u±, . . . , x k , Uk) [de- 
fined by (4.3) with initial value x] on Bk, where Bj~ is the Borel cr-algebra 
on (S x R) fc and B = a{UfcLi Bk}- Let furthermore \i x \T n the conditional 
(on .T^) infinite-dimensional distribution of (x n+ i, u n+ \, . . . , x n+ k, u n+ k, ■■ ■)■ 
Equality (4.4) implies that the finite-dimensional distributions of the mea- 
sure l± x \T n coincide with the finite-dimensional distributions of the mea- 
sure fi Xn ; that is, ii x \T n — ^x n on This implies (4.2) for the measure defined 
in (4.3). 
Furthermore, the definitions of (x n ) ne pj and (u n )neN imply that for ev- 
ery continuous / also $(x) = E x f(xi,v±, . . . , x m , v m ) is continuous in x G S. 
Hence condition (CI) holds. 

Next we check condition (C2) for q > 2. The case q = 1 has been treated 
in Example 4.2. We first show 

(4.5) supE^loglz'Ail) 2 < oo. 

To see this notice that for every A > 0, 

|x| A (log \x\) 2 

sup 

Hence for every x G S 



sup - ; rrm ='■ c < oo. 



E,.(log Ix'^l) 2 = -i T E|ar'Ai| A fe(x'A 1 )(log Ix'AxI) 2 
/i(x) 

<c*^(l + E|A 1 | A+1 )<oo, 
n* 

where h* = inf xG 5 h(x) and h* = sup xeS h(x). This implies (4.5). 
Define 

f( x ) = TT^ B \ X ' A ± I A lo § IM^i) = Ex log |x% | , 
h{x) 

and m fc = log |4._i^fc| - f(x k -i), then 

f 1 n 1 n 1 n 

(4.6) — = - V f(xk-i) + - Y] m fc := ? n + - V m fe . 

fc=i fc=i fe=i 

By the strong law of large numbers for square integrable martingales and 
(4.5) the last term in (4.6) converges to zero P x -a.s. for any x G 5. By 
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Lemma A. 9 (xn)neN is positive Harris recurrent with respect to the measure 
Pa: as defined in (4.3). Hence we can apply the ergodic theorem to the 
first term of the right-hand side of (4.6) (see Theorem 17.0.1, page 411 in 
[18]). This term then converges to the expectation of / with respect to the 
invariant measure fr: 

(4.7) lim? n = /J= / Tr(dz)-^-'E\z'Ai\ x \og\z'A 1 \h(z'A 1 ), vf-a.s. 
n ^°° Js h(z) 

This implies 

/ P x ( lim ^ = p]n(dx) = [Px( lim fn = p)it(dx) = 1. 

JS \n^oo n J Js \n^oo J 

By Lemma A. 9 the measure ff is equivalent to Lebesgue measure, hence 

(4.8) pj lim -=(3] =1 

for A- almost all x G S. From condition (CI) we conclude 
P x ( lim — = f3) = ~E x f(x h Vi), 

where I = 2q + l, and 

f(x,v) = P x ( lim V -^=p). 

By condition (C4) the function P^finin^oo ^? = (5) is continuous on S and 
therefore (4.8) holds for all x G 5. 

It remains to show that the constant (3 in (4.7) is positive. By (2.3) there 
exist c > and 7 > such that E|n n | 2 < ce~ 7n . Choose 5 > such that 
d = 7 — 25 > 0. Then by Chebyshev's inequality, 

P(|xTI n | > e~ Sn ) < e 25n E\x'U n \ 2 < e 2<5n E|n n | 2 < ce~ dn . 

Moreover, for every < p < d/X and x' n = x'U n , we have 

Pxflx'llnl < e pn ) = h~ l {x)'E\x'li n \ x h{x n )x { \ x 'ii n \<eP^} 

< C *( e -A«n + K\ x >Tl n \ X X {e - Sn < WTln \ <eP n } ) 

< c*(e- XSn + e A ^P(|x'n n | > e- Sn )) 

<c*(e- x5n + ce- { - d - xp)n ), 

where c* = h*/h*, h* = max/i and h* = min/i. By the lemma of Borel- 
Cantelli we conclude that for all x G S, 

lim — > p > P^-a.s. 

n— >oo 71 
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This verifies condition (C2). 

Finally, we check condition (C3) for q > 2. The case q = 1 has already 
been treated in Example 4.2. We shall show that for m = 2q + 1 and Vi^ElR, 
V5>0, VyGS, Ve>0, 

(4.9) inf P x (\x m -y\<e, \v m -u\<S)>0. 

Indeed, with L(z) = z/\z\, consider 

~P x {\x m - y\<e, \v m -v\<6) = P^i;'^ G T y , e ,s), 

where Ty^g = {z G M. q \ {0} : \L(z) — y\ < e, | log \z\ —u\< 5}. For every y G 5 
and every i/gR, this set is a nonempty open set in M. q , because the vector 
ZQ = e u y G T y ^ 6 (VfGl, V5 > 0, Vy G S, Ve > 0). This implies that the 
Lebesgue measure of Ty jS s is positive. By Lemma A. 13 we conclude that 

inf P x (x'U m eT y>£yS )>0. 
This ensures (4.9), which implies condition (C3). □ 

Define G(x,t) = G(x,t)/h(x), where h(-) > satisfies equation (3.7) with 

positive A for which k(X) = 1. Further, recall that by Remark 2.2 Y = A{Y\ + 

£i, where Y\ = C2 + Z)fc^=3 ^2 • • • Afc-iCfe is independent of (A\Xi) and Y\ = Y. 
Therefore, 

G(x, t) = — \- r n A P(x'Aiyi + x'Qi > u) du 
h(x)e t Jo 

(4-10) 

= :G (x,t)+g(x,t), 
where, setting t\ = x' A{Y\ and T2 = x'(i, 

1 /" et 

G o{x,t) = —— 1 u x P{ri>u)du, 
Mx)e l Jo 

(4-11) 

1 f 

9( x ' *) = rrrr / uA V^, «) 

n^xje 1 Jo 

with ip(x,u) = P(ti + T2 > u) — P(ri > it). 

Proposition 4.4. Assume that conditions (D0)-(D2) are satisfied and 
o? q + a1> 0. Then 

oo 

(4.12) G(x,t) = ^E x5 (x n ,t-w n ). 

n=0 



\ X 'A-, \* re t /\x'Ax\ 
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Proof. Lemmas 3.1-3.3 ensure the existence of positive solutions of 
equations (2.4) and (3.7) which are used in the definition of the measure 
P in (4.3). Now consider first Go(x,t). Mapping u ^ u/\x' A\\ and using 
x'i = x'Ai/\x'Ai\, we obtain 

| x / Al |A fe y\x'A 1 \ 

'/i(x)e*- 1 °sl :c ' A il 

= B x G(x 1 ,t-\og\x'A 1 \). 

Let B(S* x R) be a linear space of bounded measurable functions S x R — > R. 
Define the linear operator 6 : B(S x R) -> B(5 x R) by 

e(f)(x,t)=E x f(x 1 ,t-v 1 ), 

where we have used that vi = u\ = log Next, recall that by Proposi- 

tion 4.3, condition (CI) holds for the measure (4.3). This implies that the nth 
power of the operator is defined by Q^ n \f)(x,t) = E x f(x n ,t — v n ). Then 
equation (4.10) translates into the renewal equation G(x,t) = Q(G)(x,t) + 
g(x,t) and we obtain for all n € N iteratively, 

G(x, t) = 0W (G)(x, t) + g(x, t) + &(g)(x, t) + ■ ■ ■ + (g)(x, t). 

Moreover, condition (DO) implies limn^oo E|II n | =0, giving 

Q^(G)(x,t) = E x G(x n ,t-v n ) 



1 f et 

— u x P(x'n n Y >u)du^0, 
c)e' Jo 



n — > oo. 



h(x 

This implies (4.12). □ 

Lemma 4.5. Assume the conditions of Theorem 2.4. Then for every 
x G S, there exists 



If 1 f c 

lim G{x,t) = h(x)- / n(dz)—— \ 
t^°° p Js h(z) Jo 



u x 1 if(z,u)du 



= h(x)j* > 0. 

Here h(-) > satisfies equation (3.7) with positive A for which n(\) = 1, 
(3 > is defined in (4.7) and tt(-) is the stationary measure of the Markov 
process (x n ) n >Q under the distribution P as defined in (4.3). 

PROOF. We apply Theorem 4.1 to (4.12). Conditions (C1)-(C4) hold 
for q > 1 by Example 4.2 and Proposition 4.3. It remains to show that the 
function g given by (4.11) satisfies condition (4.1). By Lemma A. 10 follows 
that g(x,t) > and therefore 

\g( x ,t)\ =g( x ,t) < ^-(fltfOM) + gl{ x i t )), 
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where h* = mm xe s h(x) and, with n(t) = e M * for some p > 0, 

1 f et 1 f et 

gUx,t) = -r u x P(Ti>u-n(t))du T M A P(n > u) du, 

e l Jo e Jo 



We show that these functions satisfy for sufficiently large t > the inequality 

(4.13) g*(x,t)<ce- cit 

for constants c, c\ > 0. First notice that it follows immediately from Lemma 3.2 
that k(9) < 1 for every 1 < < A. Hence by the defintion of k(0) in (2.5), for 
every v € (n(9), 1), there exists some C = C v > such that for all n € N, 

ElA^-'Anf <Cv n . 

From this and Holder's inequality we obtain, for arbitrary p > 0, 

E|ri| e <E|Ai| 9 E|Yi| e 

<2 e - 1 E|A 1 |^E|eir + E^£|A 2 ---A fc _ 1 ||e fe |^ ) 

(00 
Eieii e + cEieii e x;p- 9(fc - 2) ^- 2 
fc=3 

(oo \ e ~ 1 \ 

J2p e{k - 2)/{e - 1) j j. 

Now choose in the last term p = i/V( 2e ). Then for every 1 < < A, there 
exists some m{0) > such that 

(4.14) supE|ri| e = supE|x'Aiyi| 9 < m(6) < oo. 

We study now the function g*(x,t). Indeed, for sufficiently large t > 0, we 
have 

1 re*-n(t) 

gl(x,t)<- (n(t)+u) P(n >u)du 

e* Jo 

(n(t)) A+1 



<c 



1 /" e 

- — / n A P(ri >u)du + 
e* Jo 

(n(i)) A+1 



1 re*-n{t) 

-r n A ((l + n(t)u~ 1 ) A -l)P(n>u)(in 

e 1 Jn(t) 
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e* e* 7 n (t) 

^ (n(t)) A+1 „,,m(0)n(t) 

< ^-(i-mCa+i))* + jgMg) e -(i-a- M > 
5 



where 



M*= sup ((l + x) A -l)/x, 5 = A-# and c = 2 A + l. 

0<x<l 

To obtain (4.13) for the function g*(x,t), choose the parameters 5 and \x 
such that 5 + fi < 1 and < /i < (1 + A) -1 . 

The function g^x^t) satisfies inequality (4.13), because for every m > 
by condition (D3), 

supE|r 2 r = supE|(x)i6r < E|£i| m < oo, 

x£S x£S 

where (x)i denotes the first coordinate of x G S. On the other hand, if 
t— > — oo, we have immediately from definition (4.11), 

g(x,t)<-^— f u x du<^-e xt 



h*e l Jo h* 

and, hence, condition (4.1) holds. 

Furthermore, taking into account that ff is equivalent to Lebesgue measure 
A on S (see Lemma A. 9), by Theorem 4.1 and Lemma A. 10 we conclude 

G(x t) 
lim - ; \ = lim G(x,t) 

*->oo h(x) t^oo 

= - n(dz) / g(z,s)ds 

P JS J-oo 

If 1 r+°° 

= - n(dz)-— / u x ~ l ^(z,u)du 
13 Js h(z) Jo 

= 7*>0. □ 

The proof of the following lemma is an immediate consequence of the mono- 
tone density theorem in regular variation (see, e.g., [2], Theorem 1.7.2). 

Lemma 4.6. Assume the conditions of Theorem 2.4. Then for every 
x € S, there exists 

lim t x P(x'Y >t)= i*h{x) > 0, 
with h(-) and 7* as in Lemma 4.5. 
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Example 4.7 (Continuation of Example 4.2). Lemmas 4.5 and 4.6 imply 
Theorem 2.4 with the limiting constant 

7 "Wo 2 
Symmetry of the distribution of £ implies that ?/>(l,it) = ip{— l,u), hence 

lim £ A P(xY > t) = -= / n A_1 (P(^ > «) - P(anli > u)) du 

i-»oo J 

for any x G S = {1, —1}. 

Note that this special case is already covered by Theorem 2.3 of [10]. 

APPENDIX 
A.l. A simple sufficient condition for (D4). 

Proof of Proposition 2.3. Let I = inf{fc > 1 : \c k \ > 0}. For n > I, 
set T n = J2k=i c kik- If |cfe| > 0, then by the condition of this proposition c^k 
has a symmetric density Pk(-), continuously differentiable with derivative 
Pk(') — on [0, oo). Therefore r\ has a symmetric density, which is non- 
increasing on [0, oo). We proceed by induction. Suppose that r n _i has a 
symmetric density <£V n _i( - )i nonincreasing on [0,oo). We show that T n has 
a density with these properties. Indeed, if c n = 0, then r n = T n -\ and we 
have the same distribution for r n . Consider now the case \c n \ > 0. By the 
properties of p n (-) and of <£y n _i(")> we can wr he the density (p Tn (-) of r n in 
the following form: 



( PtA z )= p n (z + u)ip Tn _ 1 (u)du+ p n {z - n)v7 r „_i(«) du 
Jo Jo 

poo 

+ J Pn(u~ z)ip Tn _ 1 (u)du, Z > 0. 

Therefore the derivative of this function equals 

roc 

t f'rn( Z )= / Pn(. U )&T n -i(u-z) -<p Tn _i (« + *))<*« 
J z 

+ [ Pn( U )( i Pr n ^ 1 ( Z - U )- l PT n _ 1 { U + Z ))du<0, Z>0, 



since p' n (-) < and f Tn -i (•) is nonincreasing on [0, oo). Therefore we obtained 
that for all n > I, the r.v. r n has a symmetric continuously differentiable 
density, which is nonincreasing on [0, oo). Moreover, since r = lim n _ )00 r n 
a.s. and the sequence (yv n (•))«>; is uniformly bounded, that is, 

SUP <Pr n (z) < ip n {0) < OO, 

z6R,n>Z 
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we have that for every bounded measurable function g with finite support 
in R 

roo roc 

lim / g(z)ip Tn (z) dz = / g(z)tp T {z) dz, 



n— »oo 



oo 



where <p T (') is the density of r. Since £1 has a continuous density, (p T is also 
continuous. Therefore, for < a < b, we have for all < 5 < a, 

b+8 i-a+S 

ip T (z)dz— / ip T (z)dz 

b—6 J a— 8 

rb+S r a+S 



/ rb+8 ra+d \ 

lim ( / ip Tn {z)dz- / (p Tn (z)dz) 

l ^°°\Jb-S Ja-6 J 



n— too 

<0. 



Since </v( - ) is continuous, we conclude 

I / rb+8 ra+8 \ 

(p T (b) -tfr (a) = lim — [ <p T (z)dz- tp T (z)dz)<0. n 
A.2. Gaussian linear random coefficient models. 

Proof of Proposition 2.6. It is evident that conditions (D1)-(D4) 
hold for this model with o\ > 0, which implies condition (D2). 

To show that the conditional correlation matrix (2.6) is positive definite 
a.s. take some i£K' such that x'Rx = 0. Then for 11^ = A\ ■ ■ - Ah, k € N, 
and B as defined in (2.6), 

oo 

x'Bx + x'U k BU' k x = 0. 

k=l 

If we denote by (x)i the ith. coordinate of x S M q , the equality above means 
that (W k x) 1 = for all k G N. Set 6 k {x) = (n^x>i for fceN and 9 (x) = (x) 1 . 
Because of the special form of the matrices (1.6) one can show by induction 
that 



(A.i) e k (x) 



a lk e k _i(x) H \~a kl {x) 1 + (x) k+1 , if 1 < k < 

&i k 0k-i(x) H \-u q (k-q+i)0k-q(x), if k > q. 



Consequenly, if k {x) = for all < k < q, then (x)\ = ■ ■ ■ = (x) q = 0. 
From this we, conclude that x'Rx = implies x = 0, which means that R is 
positive definite a.s. □ 
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A. 3. Auxiliary properties of 11^ = A\ — A n . We study the asymptotic 
properties of 9k(x) as defined in (A.l). First recall the classical Anderson 
inequality; see [13], page 214. 

Lemma A. 8 (Anderson's inequality). Let q be a r.v. with symmetric 
continuous density, which is nonincreasing on [0, oo). Then for every c£R 
and a > 0, 

P(k + c|<o)<P(|?|<a). 

Lemma A. 9. Assume model (1.1), such that conditions (Dl) and (D2) 
hold and ai + oi > 0. Then for every \x > and k € N, 

(A.2) lim sup P(\9 k {x)\<5) = 0. 

*-*0\{xh\>iM 

Furthermore, for k = q we have 

(A.3) lim sup P(\6 q (x)\ < S) = 0, ]imsupP 9 .(|0 ff (a;)| < 8) = 0, 

where P is defined in (4.3). 

Proof. We show first that for 1 < j < q and for every e > such 
that S/e — > as 5 — > 0, 

(A.4) lim sup P(|0j-(sc)| < 5, |%-i(x)| > e) = 0. 

Recall that 0oO*O = To prove (A.4) notice first that by (A.l) 
9j(x) = rjij(Ti6j-i(x) +nij(x), 

mj(x) = aiOj-^x) + a 2 (j-i)0j- 2 (x) H h a jl (x)i + (x} i+ iX{j< 9 }- 

Moreover, condition (D2) implies that o~\ > and therefore by Anderson's 
inequality, [taking into account that rjij is independent of 0j_i(x) and rrij(x)] 
we obtain 

P(\9 j (x)\<5,\e j - 1 (x)\>e) 

= P(|77i i ffifl i _i(x)+m i (x)[<5,|fl i _i(x)|>e) 

<p(| ??1j |<V(^i))- 

From this and condition (Dl) we obtain (A.4). Then (A.2) follows by induc- 
tion. 

Next we show (A.3). Introduce for 5 > and 1 < j < q the sets T$ = 
f)j=iTj,s, where T j)S = {\0j(x)\ < ej} for ej = ej(5) = Notice that (A.4) 
implies 

lim sup P(T jjS n ! 5 ) = 0. 
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Set a* = maxj +J < 9 |ajj| and define F u = {\a q \\ > u}, Bn = {a* < N}. Take 
for any fixed v > 0, N > the set T$ n F u D £?jv- The definition of 
in (A.l) implies that on this set |x| — > as S — > 0. Hence, if — as in (A. 3) — 
|xj > there exists So = Sq(/j,, u, N) > such that T$ (1 F u (1 = for all 
S < Sq. Therefore for this S > and for with \x\ > p,, we obtain 

p(\e q (x)\<s) 



<P(r,) + X)P(ri,inrf_ w ) 

i=2 

< p(|q,(i) I < + p(«* >A0 + E P(r j>tf n r,_ lj5 ) 

5=2 

< p(K + a qVql | < v) + — + £ p(r ij4 n r^Li). 



5=2 



Notice that the conditions a q + o~ q > and (Dl) guarantee that the first 
term in the last line tends to zero as v — ► 0. Hence, we obtain the first 
limiting equality in (A. 3). The second equality follows from the first and the 
definition (4.3). □ 

In the following lemma we compute the conditional density of JM 2q j r \X' 
in M q with respect to the random vector p = p(x) = H' q x. 

Lemma A. 10. Assume that (Dl) and (D2) hold, a 2 q + a q > and x / 
0. Then the random vector H' 2q+ iX has conditional P-density p\(z\p{x)) = 
f(z,p(x)) with respect to p{x). The function /(■, ■):!' xl ? ^ [0, oo) is given 
by 



(A.5) 

where 

(A.6) 



f(z,y) = E- 



1 



■Po(z'T \y), 



dot I 



( «!(<?+!) a 2(g+l) 



a. 



((3+1) \ 



V 



«q3 








/ 



a (g-l)3 

and for z = (z 1} -- -,z q )e W , y = (yi, ...,y q )£R q 

q 

Po(z,y) = Y[(pj(zj\zj-x,---,zi,y) 

5=1 
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. . 1 ( f Zj — m,j(z,y)\ 
(A.7) ^-(zj = X{ | | >0} E— , 

m 1 (z,y) = aiyi + y 2 , and for j > 1, 

mj(z,y) = aiZj-i + a 2 (j-i)^-2 h oyiyi + yj+iX{j< 5 }> 

where zq = y\ and the density (j) is defined in condition (Dl). 

Proof. Let x = (xi, . . .,x q )' € R q such that x g / 0. We show that the 
vector Tl' q+l x has density f(-,x) as defined in (A. 5). To this end we show 
first that x'Tlq+i = 9(x)'T, where the matrix T is defined in (A. 6) and 
Q(x) = (9 q (x),...,9 1 (x))' G R q . By the definition of A,- in (1.6) we have (x'lL q+1 ) q = 
(x'U q A q+1 ) q = a q ( q+1 -)(x'Ilq)i and for 1 < j <q- 1, 

(z'n g+1 )j = (x'rig^g+i)^ = a j{q+1) {x'ii q )i + (x'n (? } j+1 

= • • • = aj-( g+ i)^(x) + • • • + a iq _ 1)[j+2) j+1 (x) + a g (j + i)^(x). 
This gives x'H q+ i = 9{x)'T. Next note that a q + a q > implies 

|detT| = [] |a 3 (j + 1)| = 1] l°« + + > 0» p - a - s - 

3=1 3=1 

Immediately by (A.l) the vector 6{x) is measurable with respect to a{ctik, 1 < 
i < q,l < k < q,i + k < q + 1}. Hence, T is independent of 6(x). Therefore to 
prove that the vector II' +1 x has density f(-,x), it suffices to prove that 0(x) 
has density po (•, x) as in (A.7). Indeed, if xi ^ 0, then condition (D2) guaran- 
tees a\ > and #i(x) = anxi + x 2 has positive density </?i(-|x) as defined in 
(A.7). This implies that 9\{x) ^ a.s., and therefore 9 2 {x) = a\ 2 9\{x) + a 2 \X\ + X3 
has conditional density pg 2 (z 2 \9i(x)) = (f 2 (z 2 \9i(x), x), where the function ip 2 
is also defined in (A.7). Similarly, we can show that pg j (zj\0j-i(x), . . . , 9\{x)) = 
ifj(zj\9j-i(x), . . . ,6i(x),x) for every 2 < j < q. Therefore 9{x) = (9 q (x), . . . , 
9\{x))' has density (A.7) in M. q provided x\ 7^ 0. 

To complete the proof we recall that (A. 3) implies (p(x))i = 9 q (x) 7^ a.s. 
for every vector x 7^ 0. Therefore, taking into account that the A n are i.i.d. 
and p(x) independent of {A q+ i, . . . ,A 2q+ i}, we obtain that the conditional 
[with respect to p{x)\ density of the vector n' 2 +1 x = {A q+ \ ■ ■ ■ A 2q+ i)'p(x) 
equals /(-,p(x)) a.s. for x 7^ 0. □ 

The following result is an immediate consequence of the definition of P 
in (4.3) and Lemma A. 12. 

Corollary A. 11. Under the conditions of Lemma A. 10, the random 
vector Ii' 2q+1 x has a conditional P-density with respect to p(x) given by 

(A.s) n (z\ P ) = p^Pi (*\p), z, P eR q ,z^o,p^o, 
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for pi(z\x) as defined in Lemma A. 10. 

Lemma A. 12. Assume that conditions (Dl) and (D2) hold and ai + oi> 0. 
Then for 6, x € M. q and x ^ 0, 

P(x / n 2g+ i6 = 0) >0 6 = 0. 

Proof. Lemma A. 10 implies that 

P(x'U 2q+1 b = 0) = BP(x'U 2q+1 b = 0|p(x)) 

= E / p!(2:|p(x))^. 

J{2GM'':^ / 6=0} 

If this probability is positive, then there exists a vector p6R' with ^ 0, 
such that 

/ p 1 (z\p)dz>0. 

J{zeRQ : z'b=0} 

This is possible if and only if b = since the Lebesgue measure of the set 
{z£R ? : b'z = 0} equals to zero for all 6/0. □ 

Denote by mes(-) the Lebesgue measure in R q . 

Lemma A. 13. Assume that conditions (Dl) and (D2) hold, q>2 and 
a q + a q > 0. Then there exists some 5q > stic/i t/iai /or all < 5 < 5q, 

mfP(x'U 2q+1 eB)>p,(5) f i 5 (B), 

(A.9) „ 

inf P x (x'n 2g+1 £ B) > p m (S)fi s (B) t 

/or every measurable set 6C1 ? . i/ere p* (o~) , j5* (<5) > and 

M(B) = E [ X B(z'T)dz, 
Jn s 

(A.10) fL S {B)=vf \z'T\ x XB {z'T)dz, 
Jn s 

n s = {y = (y u .. .,y q )' e R« : 6 < \ Vj \ < (T 1 , j = 1, . . . , ?}, 

and tae matrix T is defined in (A. 6). Moreover, if mes(B) > 0, then there 
exists some Sq > such that fJ-s(B) > and fis(B) > for all < 5 < 5q. 



Proof. From Lemma A. 10 we know that for a some < 5 < 1, 
P(x'n 2g+ i e fi) = EP(x'n 2 ,+i € B|p(x))> Ex Mx)e ^ } / B (p(x)), 
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where Kg = {y = (yi, . . . , y q )' G W 1 : 8 < \y\\ and \y\ < S^ 1 } and 
i b(p) = / Xb(z)pi{z\p) dz 



= E / XB(z'T)p Q (z,p)dz 
>B f XB(z'T) Po (z,p)dz. 



Next we show for if£ = M« \ K s , 

lim supP(p(x) G i^) = 0, 

(A.H) 

lim sup P x (p(x) £K%)=0. 

Indeed, we have 

P(p(x) G Kf) < P(|(p(x)>i| < 5) + P(|p(x)| > r 1 ) 
<su P P(|0 g (x)|<<5) + <5(EL4i|) 9 . 

(A. 3) gives the limits in (A. 11). 

Notice that (A. 7) implies that M*(5) =mf zG Q StXG KsPo( z i x ) > f° r every 
5 > 0, which yields P(x'U 2q+ i G B) > M*(5)P{p(x) G K s )ns{B). From this 
and (A. 11) we obtain the first inequality in (A. 9). Similarly, we prove the 
second. 

Let B be a measurable set in M q . By the monotone convergence theorem 
we have 

\im n s (B) =mes(S)E|detT|" 1 , 

lim/i 5 (JB)= / |z| A xs(-2)(izE|detr| _1 . 

Since | detT| < 00 a.s., this implies the second part of the lemma. □ 

The following lemma is needed to verify condition (C4). 

Lemma A. 14. Assume that conditions (Dl) and (D2) hold and a q + o~ q > 0. 
Then 

$(x,t) = E x f{x'n 2q+1 ,t), xeS,teR, 

is uniformly continuous on S for every measurable bounded function f : S x 
E — » R; tfiai is, 



lim sup sup i) — <3?(y, i)| = 0. 



£ ~ *^ |a;— j/|<e 
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Proof. Let V : — > [0, oo) be a continuous function such that V(z) = 
for \z\ > 1 and / R , V(z) dz = 1. For some e £ (0, 1), define K e = {y G W : > 
e,\y\ <l/e}, f £ = e/4 and £ (x) = jj y |< 1 xjf e (x + z/ e y)F(y) dy. Then & : M 9 -> 
[0, 1] is continuous, such that g e {x) < XK €/4 (x) and g t {x) = 1 — g t (x) < Xk^ (x) 
for every x G M q . We can represent the function $ in the following form: 

$(x, t) = E x f{x'U 2q+1 ,t) = E x g e (p(x))f(x'U 2q+1 ,t) + A e (x), 

where A £ (x) = E x g t (p(x))f{x'U 2q+1 , t). By (A. 11), setting /* = sup |/|, we ob- 
tain 

A: = sup |A e (x)| < /* su P P x (p(x) G K c 4t ) ^ 0, e - 0. 

From the definition of E in (4.3) we obtain 

E x g e (p(x))f(x'll 2q+1 ,t) = ■j^rEg e {p(x))f 1 (a/U 2q +i,t), 

where f\(z,t) = \z\ x h(z)f(z, t). By Lemma A. 10 we can represent this term 

as 

^9e(p(x))fi(x'U 2q+1 ,t) = E / 7i(^*)^e(2,p(a:))d2! 

= E* 6 (p(x),t) 

with i) = E/i(z'T, i) and ^ e (2, p) =po( z ; P)9e{p)- Here 1 I / e allows the rep- 
resentation 



*e (/»,<)= / fl(z,t)l/>e(z,P)dz+ f 1 (z,t)lp e (z,p)dz 

Jn s JWi 

(A.12) 

= ^(p,t) + A ej(5 (p,t), 

where fij = {?/ G M 9 :<5 < |(y)j| < <5 _1 ,j = 1, Next we show that for 

every e > 0, 



(A.13) lim sup P(0(p) e n§) = 0. 

6/4 



To this end note 



sup P(0(p)efi§) 

< £ sup P(|0»| < 5) + sup P(|0(p)| > 1/5) 

j=1 \{p)i\>e/A |p|<4/e 

sup P(|#j(p)| <<5)+5 sup E|0(p)|. 

j=ll<P>i|>e/4 |p|<4/e 
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By the definition of 9(p) in (A.l) we find for every m > some constant 
c m > such that 

sup E|^( / o)| m <c m /e m <cx). 
|p|<4A 

Therefore the limit relation (A. 2) implies (A. 13). Moreover, notice that the 
last inequality yields 



lim sup E>X{\8{p)\>N}\0(p)\ =0. 

|p|<4/e 

Next we estimate A tt g(p,i) as defined in (A. 12). Taking into account that 

\7i(z,t)\<f*h*E\T\ x \z\ x = fi\z\\ 
we obtain for p £M q and N > 0, 

|A e>tf (p,t)| <fig e (p) [ \z\ x Po (z,p)dz 
= nge(p)E\0(p)\ x X{e{p)£Q c } 

< fiX{ P eK c/4 }(N x P(8(p) G Q c s ) + E Xmp) i>N}\0(p)\ X ). 
This together with (A. 13) ensures for every e > 0, 

A* 5 = sup |A C)5 (p,t)| — > as 5^0. 



From this we conclude for x,y G S such that \x — y\ <r/ and for p > 0, 

\$(x,t)-$(y,t)\ 

< E\h-\x)^ e> s(p(x),t) - h- 1 (y)^ eiS (p(y),t)\ + 2A* e + 2A* 5 

< ^,s\h~\x) - h-\y)\ + 2A £ * + 2A* 5 

+ Yxfi^es(n s )E sup \ip e (z,p(x)) - tp e (z, p(y))\, 
o zea 5 

where \P* $ = sup <j|- Since ijjei'i an d p(-) are uniformly continuous on 0,g x M q 
and on S, respectively, taking the limits lim e ^o lim^ >o lim^^o implies Lemma A. 14. 

□ 



A. 4. General Markov properties of (x n ) n ^. We consider now the Markov 
chain (x n ) n ^fq as defined in (1.10). Criteria for uniform ergodicity are based 
on "small" sets. A set T G B(S) is called a small set if there exists an 
m G N and a nontrivial measure v m on B(S) [i.e., Vm{S) > 0] such that 
P m (x,A) > ^(A) for all cc G T and j4 G B(S). As a general reference on 
Markov processes, we refer to [18]. 
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Lemma A. 8. Assume that conditions (Dl) and (D2) hold, q > 2 and 
a 2 . + 0"^ > 0. Then the following hold: 

(a) The distribution of the random vector x 2q +i has the following proper- 
ties: let A be a measurable set in S and denote by A(-) the Lebesgue measure 
on B(S), then: 

(i) ifA(A) > 0, then mi yeS Py(^2 9 +i & A) > and inf yeS P 3/ (x 2 g+i G 
A) > 0; 

(ii) if A(A) = 0, then P y (x 2q+1 G A) = and Pj / (x 2(? +i G A) = /or 
aZZ y £ S. 

(b) XTie Markov chain (x n )nGN ('wd/i respect to both measures P and P J 
zs A-irreducible and aperiodic. Moreover, every measurable subset of S is 
small. 

Proof, (a) Recall that x' n = x'I[ n /\x'Yi n \. Note that for every x £ S 
and every measurable set A G S, 

Px{x 2q +i E A) = P(x'U 2q+1 E B A ), 

Px{x2q+1 €A) = P x ( X 'lL 2q+1 G B A ), 

where B A = L _1 (A) = {y G M"\{0} : L(y) G A} and L(y) = y/\y\. From (A.9) 
we obtain for some < 5 < 1, 

P 29+1 (x,A) >p,(*) A ti(B j4 ) = i/i(A), 

(A.14) 

P 2 " +1 (x,A) >p,(5)/i s (B j4 ) = i/i(A) 

for positive constants p*(8) and p*(5). 
Next we show 

(A.15) A(A)>0 mes(B A )>0. 

Recall that q > 2, hence, if A(A) > 0, there exists a open set V Q A C S 
with A(V) > 0. Then C S^, but this set is open and nonempty 

in M. q [L(-) is a continuous function on R 9 \ {0} and V C L -1 (V)], therefore 
mes(L _1 (V)) > 0, which gives (A.15). If mes(B A ) > 0, then, by Lemma A. 13, 
there exists some 5 > such that fi$(B A ) > and fi$(B A ) > 0. Then (i) 
follows from (A.14). Next we show that 

(A.16) A(A) = mes(B A )=0. 

Assume that mes(B A ) > 0. Then there exists an open set V C B A with 
mes(V) > 0. By definition of B A the image U = L(V) = {L(y) y G V} C A. 
We show that £7 is an open set in 5. Indeed, for zq €U there exists yo G V 
such that zq = L(yo) = yo/\yo\- Since V is open, there exists some 5 > 
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such that {y G M. g : \y — yo\ < 6} C V. Set e = <5 / 1 2/q | and take z G S such that 
\z — zq\ < e. Note that for y z = \yo\z we have L(y z ) = z and 

\Uz ~ yo\ = \yo\\z - z \ < \y \e = 5. 

Hence, y z G V and therefore z £U, that is, {z € 5 : \ z — zo\ < e} C U. Con- 
sequently U = L(V) is an open set in S. For q>2, the Lebesgue measure of 
any open nonempty set in S is positive. This is a contradiction to A(A) = 
and, hence, (A. 14) holds. Furthermore, if mes(BA) = 0, then by Lemma A. 10 
and Corollary A. 11, 

P y (x 2q+1 EA) = BP(y'U 2q+1 G B A \p(y)) 

= B f Pl {z\p(y))dz = 0, 
Jb a 

P y (x q+1 G A) = B y P y {y'U 2q+1 G B A \p{y)) 

= E y [ p 1 (z\p(y))dz = 0. 
Jb a 



(b) Note that (i) and (ii) immediately imply A-irreducibility and ape- 
riodicity. From inequalities (A. 14) we conclude then that every measurable 
subset in S is small. □ 

Lemma A. 9. Assume that conditions (Dl) and (D2) hold, q > 2 and 
a q + a q > 0. Then the Markov chain (x n ) n >o with state space S is positive 
Harris recurrent and uniformly geometric ergodic with respect to P (and 
P). It has invariant measure tt(-) [and tt(-), resp.], which is equivalent to 
Lebesgue measure A(-) on S. 

Proof. Define V:R«-> [l,oo) by V(y) = l + \(y) 1 \. Then 

E x V(xi) = 1 + E?(z) = L(x)V(x), 

where ?(x) = | (a;' Ai) 1 1/ Ai | and L{x) = (l + Es{x))/V(x). Since a 2 q + a 2 q > 
implies that a ql > 0, P-a.s., we obtain 

lim L(x) = -fl + E-' a 



\(x) 1 \~*l:x£S 2\ \a>i 




< 1. 



Thus, there exist r > and e < 1 such that swp^^ >r L(x) < 1 — e, and we 
obtain that V(-) satisfies on the set r = {x G S : \{x)i\ < r}: 

sup / V(y)p(x, dy) < oo 
xerJs 
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and, for some e G (0, 1), 

/ V(y)p(x, dy) < (1 - e)V(x) for all x G T c . 
Js 

By the second part of Lemma A. 8 every subset of S is small. Since (x n )n>o is 
aperiodic, (x n ) n >o is uniformly geometric ergodic with respect to P (see [18], 
page 355). In the same way uniform geometric ergodocity of (x n ) n >o with 
respect to P can be shown. Therefore, (x n )n>o has stationary distribu- 
tions 7r(-) and tt(-), respectively. Next we use Lemma A. 8(a) to show that 
7r, respectively, n are equivalent to Lebesgue measure on S. If vr(yl) = 
linin^oo P x (x n 6 A) = and A(A) > 0, then by Lemma A.8(a)(i), we ob- 
tain the following contradiction 

ir(A) = lim P x (x n+2q+ i EA)= lim f P y (x 2q+ i G A)P^ n) (x,dy) 

> inf P y (x 2q +i G A) >0. 

2/£<S 

Next, if A(A) = 0, then by Lemma A.8(a)(ii), 
ir(A) = lim P x (x n+2q+ i G A) 



Jim f P^+l G A)p( n \x,dy) = 0. 



Hence, tt(-) and A(-) are equivalent on S. In the same way we obtain the 
equivalence of 7f(-) and A(-) on S. □ 

A. 5. A property of ip. 

LEMMA A. 10. If conditions (DO) and (D4) hold, then the function ip(x,u) 
defined in (4.11) is nonnegative, and for all x = ((x)i, . . . , (x) q )' G S with 

(A. 17) mes({u>0:i/)(x,u) > 0}) > 0, 

where mes(-) denotes Lebesgues measure on M. 

Proof. By definition we have ip{x,u) = P{t\ + t 2 > u) — P{t\ > u) with 
t\ = x' A{Y\ and t 2 = x'Q\ = (x)i^i. If {x)\ = 0, then T2 = 0, and there- 
fore ipo(x,u) =0. We show that i/jq(x,u) > if {x)\ ^ 0. By conditioning 
on T2 we get 

roo 

ip(x,u)= / (P(u-t <Tl <u) -P(u<Tl < U + t))p T2 (t) dt 

Jo 

5(u,t)p T2 (t) dt, 
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where p T2 ( m ) is the density of T2, which is by condition (D4) symmetric and 
nonincreasing on [0, 00). Setting A = a{Ai,i £ N}, again by condition (D4), 
the conditional density p Tl (-|^4) of t\ is symmetric and nonincreasing on 
]R + a.s. Therefore the nonconditional density p Tl (") of t\ have the same 
properties. Thus for < t < u, we have 

ru ru+t 

5{u,t) = / p T1 (a)da— / p T1 (a)da 

J u—t Ju 



u—t 



(Pti (a) - P T1 (a + t))da> 0. 



On the other hand, for t>u,we get 



5(u,t) 



rO ru ru-\-t 

/ p T1 (a)da+ / p T1 (a)da— / p T1 (a\A) da 
Ju-t Jo Ju 



t—u 



(p T1 (a) - p T1 (a + 2u)) da 

ru 

+ / (p Tl (a) -p Tl (a + u))da 
Jo 

>0, 



again since p Tl (-\A) is nonincreasing on ]R + . This proves the first part of 
the lemma. 

We show now (A. 17). Let ao > such that p n («o — s) > p Tl (ao + s) for 
every < s < ao and < to < «o such that P(t2 > to) > 0. Then for to <t < 
ao and ao < u < ao + to/2, 

ru 

8(u,t)= / {p n (a) - p Tl (a + 1)) da 

J u—t 

> / (p Tl (a) -p Tl (a + t ))da 

Jao—to/2 

>0. 

This implies (A. 17) immediately. □ 
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